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Abstract 
State mandated tests have taken center stage for assessing student learning and for holding 
teachers and students accountable for achieving adequate progress. What types of early 
knowledge predict performance on these tests, especially among low-income children who are at 
risk for poor performance? We report on a longitudinal study of 519 low-income American 
children from ages 5—12 with a focus on mathematics performance. We found that nonsymbolic 
quantity knowledge and repeating patterning knowledge at the end of preschool were reliable 
predictors of performance on standards-based high-stakes tests across three different grade levels 
(46 grade), over and above other math and academic skills. Further, these effects of 
preschool math knowledge were partially mediated through symbolic mapping and calculation 
knowledge at the end of first grade. These findings suggest that nonsymbolic quantity knowledge 
and repeating patterning knowledge prior to formal schooling are valuable indicators of low- 


income children’s performance on high-stakes state math tests in the middle grades. 


KEYWORDS: Student Knowledge, Math Education, High Stakes Testing, Child Development, 
Longitudinal Studies 
Educational Impact and Implications Statement 


Students are typically required to complete annual, statewide tests that measure important 
learning outcomes and assess whether students meet state academic standards. We found that 
two skills in preschool were important predictors of how children performed on a high-stakes 
state math test seven years later: children’s knowledge of repeating patterns (e.g., what two 
objects come next in this sequence?) and children’s knowledge of nonsymbolic quantities (e.g., 
which picture shows more grapes?). These results can help inform early math content standards, 
which currently do not emphasize these two skills. Further, these results should encourage 
educators to attend to these two skills in early math settings as they may provide a foundation for 
later mathematics learning. 
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Predicting success on high-stakes math tests from preschool math measures among children from 


low-income homes 


Low-income students often struggle to become proficient in mathematics. For example, 
on the 2015 National Assessment of Educational Progress (NAEP), only 24% of low-income 
fourth-grade students were at or above proficiency in math, and 28% were below basic 
(https://www.nationsreportcard.gov/). In contrast, 58% of students from more advantaged homes 
were at or above proficiency in math, and only 8% were below basic. Shin and colleagues (2013) 
report similar achievement gaps across fourth through seventh grade. One reason low-income 
students struggle in math is because they begin school with weaker math skills than their middle- 
income peers (Jordan, Kaplan, Olah, & Locuniak, 2006; Jordan, Kaplan, Ramineni, & Locuniak, 
2009; Starkey, Klein, & Wakeley, 2004). Further, one study suggests these differences in early 
math knowledge between lower- and middle-income students largely account for the differences 
in their later math achievement in third grade (Jordan et al., 2009). 

The goal of the current paper is to expand our understanding of the types of early math 
knowledge that are important predictors of low-income children’s performance on standards- 
based high-stakes tests in 4" through 6" grade. Prior research has focused on symbolic numeracy 
knowledge—knowledge of whole numbers and number relations, which includes skills like 
counting, calculation, and symbolic mapping (1.e., mapping between symbolic numerals, verbal 
number names, and their magnitudes; Purpura & Lonigan, 2013). Here, we test the hypothesis 
that two other skills before school entry—trepeating patterning and nonsymbolic quantity 
knowledge—are predictors of low-income children’s performance on a high-stakes state test 


many years later. Repeating patterning knowledge includes the ability to identify and extend 


PREDICTING SUCCESS ON HIGH-STAKES MATH TESTS 4 


predictable sequences that have a part that repeats (repeating patterns). Nonsymbolic quantity 
knowledge is knowledge of the magnitude of sets that does not rely on verbal or symbolic 
number names (e.g., a picture of four dots shows more than a picture of three dots). We also test 
the hypothesis that children’s symbolic mapping, calculation and repeating patterning knowledge 
in first grade mediate this relation. We evaluated these hypotheses in a longitudinal sample of 
over 500 low-income children from ages 5-12. Below, we discuss the importance of predicting 
performance on high-stakes tests and then introduce the literature on early math knowledge. 
High-Stakes Tests 

In the current study, we focus on predicting performance on standards-based high-stakes 
tests in Tennessee. One of the cornerstones of The No Child Left Behind Act (NCLB, 2002) as 
well as the Every Student Succeeds Act (ESSA, 2015) is the requirement that students complete 
annual, statewide tests and demonstrate proficiency on state academic standards. As such, high- 
stakes state tests have taken center stage as indicators of student knowledge and as tools for 
holding schools, teachers, and students accountable for meeting the standards and achieving 
adequate yearly progress. 

Most past research has focused on predicting mathematics knowledge using norm- 
referenced assessments administered by researchers. Although informative, performance on 
norm-referenced assessments may not generalize to performance on standards-based high-stakes 
tests. One reason is because the tests often serve different purposes (e.g., Bond, 1996; Linn, 
2000). Norm-referenced tests are intended to discriminate between low- and high-achieving 
students and to compare student performance and growth over time to a reference group (the 
standardization sample; Betebenner, 2008). In contrast, standards-based or criterion-referenced 


tests are intended to measure whether students learn content irrespective of other students’ 
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performance. Theoretically, states could choose either type of assessment for high stakes 
outcomes, and there are suggestions for how to turn criterion-referenced measures into a “growth 
to standards” approach (Betebenner, 2008). However, like most states (Good, Wiley, & Sabers, 
2010), Tennessee’s high-stakes tests are criterion-referenced to the state’s academic standards 


(https://www.tn.gov/education/instruction/academic-standards.html). 


Another reason that performance may not generalize is that fluctuations in standards- 
based state test scores over time or between groups are not always mirrored in fluctuations in 
norm-referenced test scores (see Horn, 2003). Additionally, teachers often report that their 
instruction prioritizes the content and format of standards-based high-stakes state tests (Abrams, 
Pedulla, & Madaus, 2003), so the predictive power of early math skills may be attenuated 
relative to previous findings. One study reported a strong correlation (7 = .77) between third- 
grade students’ scores on an individually-administered norm-referenced test (i.e., Woodcock- 
Johnson Assessment) and a standards-based state test (i.e., Delaware State Testing Program; 
Jordan et al., 2009). This suggests some support for the idea that performance may generalize 
across tests; however, given the differences between these test types, evidence is needed. 

Critically, we have not found research using standards-based state tests that works to 
identify a range of early math skills that are predictive of later achievement. There is some 
limited research that suggests early symbolic numeracy knowledge predicts scores on future 
standards-based state tests (e.g., Jordan et al., 2010). For example, the Test of Early Numeracy 
(TEN-CBM) assesses kindergarten and first-grade students on four symbolic numeracy tasks, 
and it predicts performance on state tests at the end of third grade (Missall et al., 2012). 
However, little is known about predictors of state test scores beyond general symbolic numeracy 


knowledge or about predictors in preschool, when symbolic numeracy knowledge is limited. 
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Given that state tests are primary indicators of important learning outcomes, it is critical to 
identify predictors of performance on those tests in particular. 
Preschool Math Knowledge 

Based on a synthesis of the literature on early math cognition, Rittle-Johnson and 
colleagues (2017) identified three types of math knowledge in preschool that predict later 
mathematics knowledge on norm-referenced tests: counting, nonsymbolic quantity knowledge 
and repeating patterning knowledge. In preschool, there are sufficient individual differences in 
these three types of knowledge to predict later mathematics knowledge, although most studies 
have focused on only one type of early knowledge. Note that other types of math knowledge 
begin to develop in preschool, but individual differences in those knowledge types are just 
emerging at this age and have not been shown to predict later mathematics knowledge. 

Among these early math skills, counting knowledge receives the most attention in 
preschool (Nguyen et al., 2016). Counting knowledge includes knowing the verbal number 
names, making a one-to-one correspondence between objects and verbal number names, and 
using the largest verbal number name to identify the cardinality of the set (Purpura & Lonigan, 
2013). It draws on a range of cognitive skills, including linguistic, spatial, and quantitative skills 
(Ansari et al, 2003). Counting knowledge at ages four and five predicts performance on norm- 
referenced math tests in elementary school (Aunola, et al., 2004; Muldoon, Towse, Simms, 
Perra, & Menzies, 2013), including for children from low-income homes (Nguyen et al., 2016). 

An earlier developing and more basic skill is now recognized as contributing to 
mathematics development: nonsymbolic quantity knowledge. Nonsymbolic quantity knowledge 
is knowledge of the magnitude of sets that does not rely on verbal or symbolic number names 


(e.g., a picture of four dots shows more than a picture of three dots, sometimes called 
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quantitative skill). This knowledge begins to develop in infancy, including the ability to 
discriminate between small set sizes (Starkey & Cooper, 1980) as well as large set sizes (Xu, 
Spelke, & Goddard, 2005). Starting in preschool, individual differences in nonsymbolic quantity 
knowledge are related to performance on norm-referenced math tests six months to two years 
later (Feigenson, Libertus, & Halberda, 2013; LeFevre et al., 2010). The relation is strongest 
before age six (Fazio et al., 2014). Recently, we confirmed that these findings generalized to 
low-income children and to predicting math knowledge six years later on norm-referenced tests 
(Rittle-Johnson, Fyfe, Hofer, & Farran, 2017). Here, we tested the hypothesis that past findings 
would generalize to predicting standards-based high-stakes test scores five to seven years later. 
Finally, repeating patterning knowledge is emerging as an important type of early math 
knowledge (see Burgoyne, Witteveen, Tolan, Malone, & Hulme, 2017). Repeating patterns are 
linear and have a unit that repeats (such as red-blue-blue, red-blue-blue). Four- and five-year- 
olds are often asked to copy or extend repeating patterns (Clarke, Clarke, & Cheeseman, 2006). 
Repeating patterning knowledge draws on multiple cognitive skills, including relational 
reasoning, executive function, and spatial skills (Miller, Rittle-Johnson, Loehr & Fyfe, 2016; 
Collins & Laski, 2015). Children who received an intervention in preschool focused primarily on 
repeating patterns had increased number knowledge at the end of kindergarten relative to 
children who had not received the intervention (Papic, Mulligan, & Mitchelmore, 2011). For 
example, children who received the patterning intervention were more successful counting 
forward and backward and knowing the number word before or after a given number word. 
Further, recent evidence indicates that low-income students’ repeating patterning knowledge at 
the end of preschool was a unique predictor of fifth- and sixth-grade math knowledge on norm- 


referenced tests (Nguyen et al., 2016; Rittle-Johnson et al., 2017), in part because it predicted 
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better numeracy knowledge in first grade. In this study, we tested the hypothesis that findings on 
the importance of early repeating patterning knowledge would generalize to predicting scores on 
standards-based high-stakes tests five to seven years later. 

Compared to counting, repeating patterning and nonsymbolic quantity knowledge are 
likely less dependent on verbal skills and learned knowledge, such as the verbal number words 
and their meaning. Attention to regularities and to quantities in the environment should be less 
dependent on the verbal input of others and on the verbal skills of the child. This may be 
important among low-income children because they often receive less verbal input from adults 
and have poorer verbal skills than children from more affluent families (Hart & Risley, 2003). 
Mediating Role of First-Grade Math Knowledge 

A second goal of this paper was to work towards a better understanding of how repeating 
patterning and nonsymbolic quantity knowledge in preschool might support later performance on 
standards-based high-stakes tests. We explore the possibility that repeating patterning and 
nonsymbolic quantity knowledge provide foundational support for key skills in early elementary 
school, which in turn support later math achievement on high-stakes tests. 

A recent synthesis of the early math cognition research indicated that, in early elementary 
school, symbolic mapping, calculation and patterning knowledge are three types of math 
knowledge that have been shown to predict later mathematics achievement (Rittle-Johnson et al., 
2017). Symbolic mapping is knowledge of mappings between symbolic numerals, verbal number 
names, and magnitudes, and it includes a variety of skills such as labeling a set of objects with a 
verbal number name or a written numeral and comparing the values of verbal or written numbers 
(e.g., 7 is greater than 6; Hurst, Anderson, & Cordes, 2017; Jordan et al., 2006). There are well- 


established links between symbolic mapping knowledge in the primary grades and a range of 
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math outcomes on norm-referenced tests across elementary school (De Smedt et al., 2013; Fazio 
et al., 2014; Fuchs et al., 2014; Geary & vanMarle, 2016). 

Calculation knowledge is the ability to calculate the composition or decomposition of sets 
(Purpura & Lonigan, 2013). Calculating with the support of objects at ages five and six is 
correlated with performance on a norm-referenced test two years later (LeFevre et al., 2010). 
Further, general calculation knowledge in first and second grade is a strong predictor of 
performance on researcher-designed math measures and norm-referenced math achievement in 
the middle grades (Cowan et al., 2011; Geary, 2011; Jordan et al., 2013). 

In addition to symbolic mapping and calculation, repeating patterning knowledge may 
continue to be a valuable predictor in early elementary school. Past research with elementary 
school children has typically focused on a broad range of pattern types, not just repeating 
patterns. They often describe patterns as knowledge of any predictable regularity, ranging from 
symmetrical patterns (A B C C B A) and growing patterns (2 4 6 8) to triangular patterns of dots 
and partitioning into halves, thirds and fourths (Mulligan & Mitchelmore, 2009; Kidd et al., 
2014). Importantly, a six-month patterning intervention for struggling first-grade students 
improved their performance on a norm-referenced math test at the end of the school year, 
mediated through improvements in their broad patterning knowledge (Kidd et al., 2014; Pasnak, 
Kidd, Gadzichowski, Gallington, Schmerold & West, 2015). However, there is some concern 
that repeating patterns are not sufficiently advanced to support broader patterning knowledge, 
which often involves patterns in numbers and quantities (National Mathematics Advisory Panel, 
2008). In contrast to this concern, recent evidence suggests that repeating patterning knowledge 


in first grade predicted later performance on norm-referenced math tests among low-income 


PREDICTING SUCCESS ON HIGH-STAKES MATH TESTS 10 


students (Rittle-Johnson et al., 2017). Thus, it is important to continue to evaluate the relevance 
of repeating patterning knowledge in early elementary school. 

Nonsymbolic quantity knowledge and repeating patterning knowledge in preschool may 
help to develop these three skills (i.e., symbolic mapping, calculation, and repeating patterning) 
in first grade. For example, nonsymbolic quantity knowledge provides a foundation for mapping 
between magnitudes and verbal and symbolic numbers (Feigenson et al., 2013) as well as an 
intuitive understanding of basic calculations (Barth et al., 2005). Nonsymbolic knowledge of 
equivalent sets may also support copying a pattern or recognizing the number of elements in a 
single pattern unit. Improving repeating patterning knowledge in preschool has also been shown 
to support symbolic mapping and calculation knowledge (Papic et al., 2011). Working with 
repeating patterns may provide opportunities to deduce underlying rules, supporting future 
success detecting rules and regularities in numbers (e.g., Greenes, Ginsburg & Balfanz, 2004). 

In sum, we predict that repeating patterning and nonsymbolic quantity knowledge in 
preschool would be unique predictors of students’ performance on standards-based state math 
tests in 4" through 6" grade, over and above the influence of other math and academic skill. In 
addition, we predict that symbolic mapping, calculation, and possibly repeating patterning would 
be key predictors in first grade, and these first-grade skills would mediate the relations between 
preschool math knowledge and later math achievement. (Figure S1 in the supplemental materials 
provides a visual diagram of the predicted model). These relations are especially important to 
explore among low-income students whose later achievement is known to be problematic. 

Method 


Participants 
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Participants were from a longitudinal study of 771 children from low-income homes 
originally recruited at the beginning of prekindergarten in 2006 for a three-year study. Children 
were recruited from 57 pre-k classes at 20 public schools and 4 Head Start sites all of which 
served children who qualified for free or reduced priced lunch in a large urban city in Tennessee 
(family income less than 1.85 times the U.S. Federal income poverty guideline). Of the 771 
children in the original sample, we located and re-consented 519 children in 2013 for a four-year 
follow-up study in middle school, all within the mid-state region. Based on available data, 
students in the final re-consented sample did not differ significantly from the students we were 
unable to locate or re-consent on key measures including sex, ethnicity, free and reduced priced 
lunch status, and early math scores (see Table S1 in the supplemental materials). 

The final re-consented sample was 56% female, 79% black, 9% white, 8% Hispanic, 4% 
other races, and 9% English Learners. Based on maternal report when the children were in pre-k, 
43% of families had an annual income under $10,000, 38% had an income between $10,000 and 
$25,000, and the remaining 19% had an income over $25,000; 25% of mothers had less than a 
high-school diploma, 33% had a high-school diploma or GED, and 42% had some post- 
secondary education. The same sample was used in Rittle-Johnson et al. (2017), but with an 
individually administered norm-referenced measure at a single grade level. The current analyses 
focused on two predictive time points: the end of pre-k (V/ age = 5.0) and the end of first grade 
(M age = 7.0). Analyses predicted outcome data at three later time points: fourth grade (M age = 
10.1; 15% retained in third grade), fifth grade (M age = 11.1; 15% retained in fourth grade), and 
sixth grade (M age = 12.1; 17% retained in fifth grade). 


Outcome Measure 
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The outcome measure for this study was from the Tennessee Comprehensive Assessment 
Program (TCAP), which served as Tennessee’s standards-based high-stakes assessment for 
holding schools accountable through the period of this study. The TCAP assessment is group- 
administered by schools in a paper-and-pencil multiple-choice format. We obtained students’ 
scaled scores on the TCAP Math subtest, which measures a range of skills, including the ability 
to estimate and compare whole numbers and fractions, solve algebraic expressions, identify 
shapes, and analyze data. Each item (” = 55) is from one of five categories: (1) Mathematical 
Processes, (2) Number and Operations, (3) Algebra, (4) Geometry and Measurement, and (5) 
Data Analysis, Statistics, and Probability. See Table 1 for the proportion of items in each of these 
categories across fourth, fifth, and sixth grade. In all three grades, the test heavily emphasized 
Numbers and Operations, with a gradual decrease in emphasis over grade levels. A similar trend 
occurred for items tapping Geometry and Measurement. In contrast, there was an increased 
emphasis on Algebra and Mathematical Processes across grade levels. Overall, there is strong 
evidence for the reliability of the assessment (e.g., KR-20 estimates for the Math assessment 
range from .92-.93) and validity of the assessment (e.g., correlation with ETS EXPLORE Math 
Test was .55; Tennessee Department of Education, 2015). 

Predictor Measures 

Early math knowledge. Math knowledge in pre-k and first grade was assessed using the 
Research-based Elementary Math Assessment (REMA). The REMA (Clements, Sarama, & Liu, 
2008) has two parts, with one part focused on numeracy skills and the other part focused on 
geometry, repeating patterning and measurement skills. Based on our review of the literature, we 
broke the numeracy part into four subscales: nonsymbolic quantity, counting, symbolic mapping, 


and calculation. Purpura and Lonigan (2013) categorized REMA items similarly based on their 
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confirmatory factor analyses, except they did not have a separate category for nonsymbolic 
quantity items. We also included the repeating patterning and shape subscales from the REMA; 
there were not enough measurement items given to create a measurement subscale. We included 
as many subscales as possible at each predictive time point to control for a variety of math skills 
and examine the unique contributions of our hypothesized predictors. Table 2 has example items 
and the number of items for each subscale (see also Table S2 and Table S3 in the supplemental 
materials). Below we report within-sample reliability estimates for each subscale using 
Cronbach’s alpha values as well as omega total values (e.g., Revelle & Zinbarg, 2009). 

Repeating Patterning. Repeating patterning items (o = .56-63, m= .71-.80) tapped 
students’ ability to identify and create predictable sequences. They involved working with 
repeating patterns made of colored shapes or blocks (e.g., extending a red-blue pattern by at least 
two blocks). 

Nonsymbolic quantity. Nonsymbolic quantity items (a = 0.61-0.70, = .70-.86) tapped 
knowledge of the magnitude of set sizes from 2 to 12, without the need for verbal number labels 
or symbols. There was no time limit on these items, so children could count to help them 
complete the task, although counting was not encouraged. Thus, the nonsymbolic items did not 
directly assess the Approximate Number System or subitizing. 

Counting. Counting items (a = 0.78-0.87, @:= .86-.88) primarily involved knowledge of 
the number-word sequence and counting sets of objects, though a few items involved identifying 
the cardinality of sets and detecting violations of the one-to-one correspondence principle. Most 
items involved quantities between 4 and 10, but a few items involved larger quantities (e.g., 


counting 30 pennies). 


PREDICTING SUCCESS ON HIGH-STAKES MATH TESTS 14 


Symbolic Mapping. Symbolic mapping items (a = .77-.88, @:= .83-.90) involved 
mapping between symbolic numerals, their verbal number names and their magnitudes, 
including their relative magnitudes (e.g., matching the numeral 2 to a picture of two objects). 
Most items focused on numbers between 1 and 10, but a few items included two-digit numbers 
and one item included three-digit numbers. 

Calculation. Calculation items (a = .91, @:= .92) involved combining or separating sets 
with or without objects (e.g., 4 chocolates plus 3 chocolates). Some calculation items were given 
at the end of pre-k, but performance was too low to use the measure at that time point. The 
majority of calculations were with numbers between 2 and 10, but some items involved two-digit 
numbers (e.g., 50 + 17). 

Shape. Shape items (0. = .89-96, w= .97-99) focused on knowledge of shapes and their 
properties, including typical and atypical examples (e.g., picking out all the triangles from an 
array of shapes). 

General academic and academic skills. We assessed four cognitive skills in pre-k and 
first grade to control for general academic skills in our models. 

Reading ability. Reading ability is predictive of mathematics achievement (Duncan et al., 
2007; Watts et al., 2014). The Woodcock Johnson III Letter-Word Identification subtest was 
used as a measure of early reading ability (see Duncan et al., 2007). It assesses children’s 
abilities to identify isolated letters and words. The reported median reliability coefficient for this 
test is .94, using a split-half procedure (Schrank, McGrew, & Woodcock, 2001). 

Narrative recall. Language skill, intelligence, and working memory capacity are also 
related to mathematics achievement (Duncan et al., 2007; Geary, 2011). Narrative recall was 


used as a direct measure of the combination of these skills, as evidence indicates that narrative 
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recall is correlated with measures of vocabulary, verbal IQ and working memory (Florit et al., 
2009). In pre-k, narrative recall was measured with the information score from the Renfrew Bus 
Story — North American Edition (Glasgow & Cowley, 1994), which scores the accuracy of 
children’s retelling of a narrative. The Renfrew Bus Story developers indicate that the test-retest 
reliability of the information score is .79 (Hayward, Stewart, Phillips, Norris, & Lovell, 2008). In 
first grade, we used the Woodcock Johnson III Story Recall subtest, which has children answer 
questions about stories the assessor reads aloud. The reported median reliability coefficient for 
this test is .87 (Schrank, McGrew, & Woodcock, 2001). 

Work-related skills. Attentive behavior, especially in the classroom, should increase 
children’s opportunities to engage in and learn from instruction, and teacher-ratings of attentive 
behavior is predictive of later mathematics achievement (Duncan et al., 2007; Fuchs et al., 2014). 
Attentive behavior was measured via teacher ratings of children’s work-related skills items on 
the Cooper-Farran Behavioral Rating Scale (Cooper & Farran, 1991). These 16 items assess 
children’s attentiveness, ability to follow directions, and task persistence in the classroom on a 7- 
point behavior-anchored scale (a = .95-.96). 

Self-regulated behavior. Self-regulated behavior includes the ability to plan and finish 
tasks, and self-regulation in the prekindergarten year is related to basic math knowledge at the 
end of prekindergarten and kindergarten (Blair & Razza, 2007; McClelland et al., 2007). Self- 
regulated behavior was measured via the Instrumental Competence Scale for Young Children- 
Short Form (Lange & Adler, 1997). Teachers rated behavior in the classroom on a 4-point Likert 
scale (a = .85-.89), and we used the four items focused on self-regulated behavior, such as 
“finishes tasks and activities.” 


Data Analysis 
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For early math predictors, missing data were rare and ranged from 0% to 7%. For early 
non-math predictors, the percent of missing cases for any given variable ranged from 0% to 22%, 
with most missing data involving teachers’ ratings of work-related skills and self-regulated 
behavior. We used multiple imputation in SPSS to impute all missing values. Every analytic 
variable was included in the model. We imputed 30 datasets, which means the program output 30 
unique datasets in which the missing values were replaced with plausible estimates. Resulting 
statistics were produced for each of the 30 unique datasets, and pooled results were produced that 
took into account variation across imputations. We report the pooled results. 

In the middle grades, children were spread across different schools. To examine the 
amount of variability due to school, we calculated intraclass correlations on the outcome 
measures, which were moderate (/CCs = .16-.27). Because there was non-independence in the 
data, we used multi-level models with an individual level and a school level. We used the school 
level data from the year the TCAP scores were obtained. We treated the school intercept as a 
random effect. Individual predictors were mean centered at the individual level and treated as 
fixed effects. We used maximum likelihood (ML) to estimate the regression coefficients. We ran 
separate nested regression models for each predictive time point (end of pre-k and end of first 
grade) and for each outcome (TCAP scores in fourth, fifth, and sixth grade). 

Results 
Descriptive Statistics 

Table 3 presents descriptive statistics for key variables and correlations between 

predictors and math outcomes. Table S4 in the supplemental material contains correlations 


among the predictors. All math predictors in pre-k and first grade were moderately correlated 
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with scores on the TCAP Math assessment in the middle grades (rs = .27-.59). Patterns of 
correlations were similar across time. 
Predicting TCAP Math Achievement 

We examined whether knowledge of specific early math topics predicted performance on 
the TCAP Math assessment, after controlling for other math and cognitive skills and student 
demographics (see supplemental material for description of demographics). In each nested 
regression model, continuous variables were standardized so that parameter estimates 
represented standardized regression coefficients. Table 4 presents regression results from our 
fully controlled models. See Table S5 and Figure S1 in supplemental materials for details. 

The results were consistent across outcome years and largely supported our hypotheses 
(see Table 4). First, we predicted that repeating patterning and nonsymbolic quantity knowledge 
in pre-k would be unique predictors of low-income children’s performance on a high-stakes state 
test many years later. As shown in Table 4, at the end of pre-k, repeating patterning knowledge 
(Bs = .14-.18) and nonsymbolic quantity knowledge (Bs = .10-.14) were unique significant 
predictors of TCAP Math scores, and this was true across all outcome years assessed (fourth, 
fifth, and sixth grade). However, counting, shape, and symbolic mapping knowledge in pre-k 
were not unique predictors of math scores at any later grade. 

Second, we hypothesized that symbolic mapping, calculation, and repeating patterning 
would be the key predictors in first grade. As shown in Table 4, at the end of first grade, 
symbolic mapping (fs = .15-.18) and calculation (Bs = .19-.25) were strong, significant 
predictors of TCAP Math scores, and this was true across outcome years. Despite being a pre-k 
predictor, repeating patterning knowledge in first grade was not a unique predictor of TCAP 


Math scores (Bs = .01-.06). 
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Third, we hypothesized that the key predictors in first grade would mediate the relations 
between pre-k math skills and later math achievement. Tables 5, 6, and 7 report mediation 
models for predicting fourth, fifth, and sixth-grade TCAP Math achievement respectively. We 
used nested regression models to complete the stepwise mediation approach recommended by 
Baron and Kenny (1986). 

As shown in Tables 5, 6, and 7, the relevant predictors in pre-k were associated with the 
hypothesized mediators in first grade. For example, when predicting sixth-grade TCAP Math 
scores, the three unique predictors in pre-k were repeating patterning, nonsymbolic quantity, and 
narrative recall. Each of these three skills significantly predicted symbolic mapping and 
calculation in first grade (Bs = .13-.32, see Table 5). Further, mediation results indicate that the 
direct associations between predictors at the end of pre-k and TCAP Math scores in fourth, fifth, 
and sixth grade were reduced in strength and often not significant after including the first-grade 
mediators. For example, the direct, significant associations between repeating patterning, 
nonsymbolic quantity, and narrative recall in pre-k and sixth-grade TCAP scores (Bs = .14-.22) 
were reduced in strength and nonsignificant (Bs = .08-.09) after including the first-grade 
mediators (Table 7). We used a supplemental bootstrapping technique recommended by Preacher 
and Hayes (2008), and the bootstrapping technique produced similar conclusions (see Table S7). 

Recall that some students were retained a grade level and completed a different TCAP 
test (e.g., the third-grade TCAP instead of the fourth-grade TCAP). The results were similar 
when the retained children were dropped from the analysis (Table S6) with one noteworthy 
deviation: when retained children were dropped, symbolic mapping knowledge at the end of pre- 
k predicted fifth- and sixth-grade TCAP Math scores. 


Discussion 
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Low-income students often begin school with weaker early math knowledge than their 
more advantaged peers (e.g., Jordan, et al., 2006; Starkey, Klein, & Wakeley, 2004), and 
increasing evidence suggests that early math knowledge is highly predictive of later math 
achievement (e.g., Duncan et al., 2007; Friso-van den Bos et al., 2015; Watts et al., 2014). The 
current study provides evidence for the importance of specific types of early math knowledge for 
predicting low-income students’ performance on high-stakes math tests many years later. 
Specifically, nonsymbolic quantity and repeating patterning knowledge in preschool predicted 
scores on high-stakes math tests in fourth, fifth, and sixth grades after controlling for other math 
and non-math skills. By the end of first grade, symbolic mapping and calculation knowledge 
were the key predictors of later test performance. The results provide important evidence 
regarding key predictors of performance on standards-based high-stakes tests, tests that play a 
central role in assessing student learning and in holding students and teachers accountable for 
achieving success. 

Recently, there has been increased attention to the learning and teaching of math 
knowledge in preschool (e.g., Piasta, Pelatti, & Lynnine, 2014). Yet, there is limited empirical 
evidence for which particular early math skills are linked to later achievement. Previous 
longitudinal research on representative samples has tended to use global measures of early math 
knowledge that incorporated a wide range of skills into a single score (e.g., Duncan et al., 2007; 
Watts et al., 2014). Other studies have examined specific skills, but they only included a single 
skill or numeracy measure, without controlling for other math skills (e.g., Jordan et al., 2009). 

This past research has highlighted the role that early numeracy knowledge plays in 
supporting later mathematics achievement (e.g., Aunola et al., 2004; Jordan et al., 2009; Nguyen 


et al., 2016). Indeed, among early math skills, counting knowledge receives the most attention in 
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preschool (Nguyen et al., 2016). Clements and Sarama (2007) identify counting as the “capstone 
of early numerical knowledge, and the necessary building blocks for all further work with 
number and operations” (p. 467). Much less research has focused on the supporting role of other 
early math skills — particularly near the end of preschool when basic counting skills are near 
mastery for many children. The current study helps fill that gap. Below we outline several 
contributions of the current research, and discuss limitations and future directions. 

First, in line with other research (e.g., Papic et al., 2011; Rittle-Johnson et al., 2017), our 
findings suggest that repeating patterning plays a key role in early math understanding and 
should be integrated into theories of math development. Repeating patterning knowledge in 
preschool predicted symbolic mapping and calculation in first grade that in turn were related to 
success on high-stakes tests across fourth, fifth, and sixth grade. Repeating pattern knowledge 
draws on multiple cognitive skills, including relational reasoning and executive function (Miller 
et al., 2016). Working with repeating patterns in preschool may help children learn to extract 
underlying rules and regularities, thereby supporting future success in detecting regularities in 
symbolic mappings and calculations (e.g., any number plus one is the next number in the count 
sequence; Greenes, Ginsburg, & Balfanz, 2004). 

Repeating patterning knowledge in first grade was not a unique predictor of success on 
the standards-based state test. One possibility is that knowledge of basic, repeating patterns (e.g., 
ABABAB) may be a less reliable predictor in first grade relative to more complex patterns (e.g., 
growing patterns). For example, a first-grade intervention on varied, complex patterns led to 
increased math scores at the end of the school year (Kidd et al., 2014). Indeed, there is some 
concern that repeating patterns are not sufficiently advanced to support broader patterning or 


quantity knowledge (National Mathematics Advisory Panel, 2008). However, some past research 
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has found support for the predictive power of basic repeating patterning knowledge in first grade 
(Nguyen et al., 2016; Rittle-Johnson et al., 2017). Thus, more research is needed to consider the 
role of patterning in first grade, including multiple pattern types that vary in complexity. 

Second, our findings are consistent with work on the importance of nonsymbolic 
knowledge in preschool (Feigenson et al., 2013; LeFevre et al., 2010) and on the contributions of 
symbolic mapping and calculation in primary school to later mathematics achievement (e.g., 
Geary, 2011). Further, the effect of nonsymbolic quantity knowledge in preschool was mediated 
by symbolic mapping and calculation knowledge in first grade (see also Price & Fuchs, 2016). 
This supports theories that suggest, with time, symbolic mapping knowledge replaces 
nonsymbolic quantity knowledge in predicting future math achievement (De Smedt et al., 2013). 
Indeed, nonsymbolic quantity knowledge is thought to support students’ abilities to link 
quantities to the symbol system (Feigenson et al., 2013) and to gain an understanding of 
operating on quantities (Barth et al., 2005). 

Third, in contrast to some prior research (e.g., Aunola, et al., 2004), counting knowledge 
at the end of preschool (age 5) was not a unique predictor of later achievement after controlling 
for a variety of math and non-math skills. One possibility is that our measure primarily captured 
basic counting knowledge, which may matter more at the beginning of preschool than at the end. 
For example, Nguyen and colleagues (2016) found that advanced counting knowledge at the end 
of preschool (e.g., identifying the cardinality of a set) was a unique predictor of fifth-grade math 
knowledge, but basic counting knowledge (e.g., maintaining one-to-one correspondence) was 
not. The researchers suggest that it is the more complex counting strategies that help develop 
children’s later understanding of quantities and arithmetic (Nguyen et al., 2016). Another 


possibility is that basic counting knowledge may not make unique contributions over and above 
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certain math skills. For example, past research on counting has not typically included measures 
of nonsymbolic quantity knowledge and repeating patterning knowledge. These latter two skills 
are likely less dependent on verbal input and learned knowledge (e.g., verbal number words and 
their meaning), which may be important among low-income children who often receive less 
verbal input from adults (Hart & Risley, 2003). In general, these results do not suggest that 
counting is unimportant; rather, it may be critical to consider its influence in light of other math 
skills and to distinguish between basic and advanced counting knowledge. 

Practically, the current study may help inform math content standards and math 
instruction. The Common Core State Standards (2010) do not including repeating patterns as a 
math content standard at any grade level, which contrasts with national and past state math 
standards for preschool and kindergarten (e.g., National Association for the Education of Young 
Children, 2014). Nonsymbolic quantity knowledge also receives little attention in schools or in 
the Common Core State Standards (2010). Teachers, administrators and policy makers are 
particularly concerned with student performance on high-stakes state tests. Thus, evidence that 
repeating patterning and nonsymbolic quantity knowledge predict performance on a high-stakes 
state test may help convince stakeholders to pay more attention to both in early math settings. 

Despite the contributions of this work, several limitations suggest directions for future 
research. For example, more research is needed to examine predictors of high-stakes tests with 
diverse sample from a range of economic backgrounds. For example, previous research has 
reported differences as a function of socio-economic status for repeating patterning knowledge 
(Klein & Starkey, 2004), but not for nonsymbolic quantity knowledge (Scalise, Daubert, & 
Ramani, 2017). Thus, it will be important to continue studying how these early skills matter for 


both low-income and middle-income children. Additionally, the number of studies using 
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standards-based state math tests as the primary outcome measure is surprising low, and the 
current research is just a start. Predicting performance on standards-based high-stakes tests is 
critical given their prominence in education as well as their differences from norm referenced 
tests (e.g., Bond, 1996). Indeed, finding predictors of high-stakes test scores may be necessary to 
convince stakeholders of the potential importance of specific early math skills. Future research 
should help expand the current study by including different populations and age groups. 

Also, several of our measures exhibited somewhat low reliability estimates, and it will be 
necessary to replicate these results using various analytic methods as well as measures that are 
operationalized in diverse ways. As one example, nonsymbolic quantity knowledge could be 
measured via Approximate Number System acuity or with tasks that systematically differentiate 
between small numbers (i.e., 1, 2, and 3) versus large numbers. Similarly, symbolic mapping 
knowledge could be measured using symbolic magnitude estimation (e.g., where does the 
number 78 go on a number line from 0 to 100). As another example, patterning knowledge could 
be expanded beyond repeating pattern knowledge to include a broader range of pattern types 
(e.g., growing patterns, symmetrical patterns; Mulligan & Mitchelmore, 2009), and counting 
knowledge could focus more directly on advanced skills like identifying the cardinality of a set 
(see Geary, vanMarle, Chu, Rouder, Hoard, & Nugent, 2018). In addition, there is not 
consistency in content across state tests, and thus generalizability of the findings to other high- 
stakes tests is needed. Finally, future research needs to provide experimental evidence to test 
whether each skill plays a causal role. There is some causal evidence that a broad patterning 
intervention improves math achievement (Kidd et al., 2014) and that a numeracy intervention 


improves calculation (Dyson et al., 2015), but these are just a start. 
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In sum, the current study helps identify early predictors of high-stakes tests among a low- 
income sample in a single state. Standards-based state tests have increased in importance as tools 
to evaluate students, teachers, and, schools. The knowledge students need to score well on these 
tests is not obtained solely in the middle grades when the tests occur. Rather, knowledge building 
follows a trajectory that begins in preschool. At the end of preschool, nonsymbolic quantity and 
repeating patterning knowledge predicted state math scores in fourth, fifth, and sixth grade. In 
first grade, symbolic mapping and calculation knowledge were the key predictors, and partially 
mediated the associations between the preschool predictors and later achievement. Given the 
widespread need to better understand the development and improvement of mathematics 
knowledge, it is imperative to attend to early math skills that predict performance on high-stakes 


tests, particularly for children who are at risk of academic failure. 
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Table 1 


Proportion of Items in each Category on the TCAP MATH Subtest. 


Fourth Grade Test Fifth Grade Test Sixth Grade Test 

NItems Proportion NItems Proportion NItems Proportion 
aren 6 dl 7 1B 14 25 
Processes 
Number and 25 4S 22 40 20 36 
Operations 
Algebra 6 11 11 20 11 20 
Geomeny aud 13 24 10 18 5 9 
Measurement 
Data Analysis, 
Statistics, and 5 a) 5 a) 5 a) 
Probability 
TOTAL 55 1.00 55 1.00 55 1.00 


Note. This information is based on the TCAP Math tests administered in Spring 2015, which is 
the year that most students in the current sample were in sixth grade (Tennessee Department of 
Education, 2015). 
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Table 2 


Example Items and Number of Items for each Early Math Subscale 


Subscale Example Easier Item Example Harder Item Number of Items 
End of Pre-K End of First 
Repeating Identify the missing element in the Duplicate a single copy of the core unit 6 7 
Patterning pattern ABA_AB. of a pattern. 
Nonsymbolic Shown two cards, with 4 dots and 3 Due connecied Cue towersan ofaer 
. po ckas 7 from smallest to largest (towers made r 9 
Quantity dots: “Which one has more? 
of 6-12 cubes). 
Shown five objects in a line: “I bought ; : : 
Counting these cans of food. Count these cans. Count 3) peices andadentity ow 22 25 
ie many there are. 
Tell me how many there are. 
Symbolic Match the numerals 1-5 to the Asked to compare: “Which is smaller, 
: ; : 15 18 
Mapping appropriate number of grapes. 27 or 32? 
“Here are six pennies. Three more are 
Calculation hidden under the cloth. How many are Add 3 more to 69. -- 42 
there in all?” 
Select all triangles from a collection of Fill 6 outlines of regular hexagons with 
Shape 26 shapes; some are prototypic and simple shapes, using different 14 23 


some are not. 


compositions. 


Note. The hardest items on each subscale were not given at the earlier time point. For the shape scale, the number of individually 
scored items was higher than the number of administered items (114 at the end of pre-k and 123 at the end of first grade). On four 
items, children were presented with a map of 26 shapes and they were asked to select all the examples of a certain shape (e.g., 
triangles). Each of the 26 shapes was scored, and the final score on each of the four items represented a weighted sum of the 26 items 
(e.g., getting credit for selecting correct shapes and for not selecting incorrect shapes, see Clements & Sarama, 2008). 
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Table 3 


Descriptive Statistics and Correlations for Key Outcomes and Predictors 


Raw Score Correlation with TCAP Score 
M (SD) 1 2 3 

Outcome Measures 
(1) Fourth-grade TCAP Math 739.30 (37.94) -- 
(2) Fifth-grade TCAP Math 750.16 (40.80) 64 -- 
(3) Sixth-grade TCAP Math 746.41 (40.21) .60 .68 -- 
Math Predictors 
Repeating Patterning (pre-k) 1.97 (1.39) 42 AT 39 
Repeating Patterning (first grade) 3.67 (1.09) He 33 oe 
Nonsymbolic quantity (pre-k) 3.78 (1.51) 39 43 37 
Nonsymbolic quantity (first grade) 7.99 (1.34) 44 ot 46 
Counting (pre-k) 8.61 (4.34) Al 46 38 
Counting (first grade) 18.91 (2.48) 42 Bays 42 
Symbolic mapping (pre-k) 5.40 (3.27) 42 7 39 
Symbolic mapping (first grade) 13.94 (2.34) 49 59 50 
Calculation (first grade) 9.55 (6.23) 52 58 50 
Shape (pre-k) 12.36 (3.45) 33 38 OL 
Shape (first grade) 15.75 (2.90) 32 35 31 
Non-Math Predictors 
Reading ability (pre-k) 347.64 (21.69) 35 34 at 
Reading ability (first grade) 437.83 (26.36) 39 48 aor 
Narrative recall (pre-k) 13.79 (7.31) 30 229 .287 
Narrative recall (first grade) 493.37 (6.69) 23 24 24 
Work-related skills (pre-k) 4.97 (1.26) on 40 30 
Work-related skills (first grade) 4.89 (1.19) Al 3 45 
Self-regulation (pre-k) 2.84 (0.70) 29 38 a2 
Self-regulation (first grade) 2.70 (0.69) oy) 49 44 


Note. All correlations presented are statistically significant at p < .05. TCAP = Tennessee 


Comprehensive Assessment Program. For conciseness, we labeled each TCAP assessment based 
on the grade level of the majority of students, but some students were retained and completed the 
version for the previous grade level. 


Table 4 


Regression Estimates Predicting TCAP MATH Scores from Early Math and Non-Math Skills (N 
= 519) 


Pre-K Measures Predicting TCAP First Grade Measures Predicting TCAP 


MATH MATH 
Measure ; 4 grade 5" grade 6" grade _4"" grade 5% grade 6 grade 
Math Predictors 
ai 1g** 1g** 14* Ol 02 06 
| (.06) (.06) (.06) (.05) (.05) (.05) 
Aare 14 10 13+ 03 44 10 
(.06) (.05) (.06) (.06) (.06) (.06) 
Counting 04 02 Ol 03 04 00 
| (.08) (07) (07) (.06) (.06) (.06) 
Pes 1 1 1 15* 1g 16* 
(.07) (.07) (.07) (.07) (.06) (.06) 
Calculation -- -- -- 25" ** 19*** De e* 
_ es ze (.06) (.05) (.06) 
Shape -.02 Ol -.00 05 -.00 -.03 
(.06) (.05) (.06) (.05) (.05) (.05) 
Non-Math 
Predictors 
rie 15 06 06 4 4 09 
| (.05) (.05) (.05) (.05) (.05) (.05) 
INEETANNE Ale 09* 10* 00 03 03 
Recall 
(.05) (.04) (.05) (.04) (.04) (.04) 
aaa te 07 04 05 Qe 20 15* 
(.08) (.07) (.08) (.08) (.07) (07) 
Bere 02 09 10 -.05 -02 07 
(07) (.07) (07) (.08) (07) (07) 
Controls Included Included Included Included Included Included 


Note. Standard errors are in parentheses. Included = all models presented include the full list of 
control variables: age at predictor time point, retained a grade level, gender, ELL status in pre-k, 
ethnicity, pre-k school type (public or Head Start), and socio-economic status (respondent’s 
education level and income level). *p < .05. **p < .01. ***p < .001. 


Table 5 
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First-Grade Skills as Mediators of the Association Between End of Pre-K Skills and Fourth- 
Grade TCAP MATH Scores 


Predicting Mediators in First Grade 


Symbolic Mapping Calculation 
Pre-k predictors 
Repeating Patterning 207r** ure * 
Nonsymbolic quantity 225 Zee 
Reading ability gt al ee 
Narrative recall .10* mn PS bis 
Controls Included Included 


Predicting Fourth-Grade TCAP MATH 


Without Mediators With Mediators 

Pre-k predictors 

Repeating Patterning 22ee* alle 

Nonsymbolic quantity eee eels 

Reading ability Aor a Sacks 

Narrative recall sl 2** 07 
First-grade mediators 

Symbolic mapping -- Ot 

Calculation -- Lotte 
Controls Included Included 


Note. Included = all models presented include the full list of control variables: age at end of pre- 
k, retained a grade level, gender, ELL status in pre-k, ethnicity, pre-k school type (Head Start or 
public), and socio-economic status (respondent’s education level and income level). *p < .05. 
= 01. F** p= 001, 
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Table 6 


First-Grade Skills as Mediators of the Association Between End of Pre-K Skills and Fifth-Grade 
TCAP MATH Scores 


Predicting Mediators in First Grade 


Symbolic Mapping Calculation 
Pre-k predictors 
Repeating Patterning paaeee A isda 
Nonsymbolic quantity 2Art* 22 tx* 
Narrative recall 13** oe 
Controls Included Included 


Predicting Fifth-Grade TCAP MATH 


Without Mediators With Mediators 

Pre-k predictors 

Repeating Patterning A is ae 

Nonsymbolic quantity st** .08 

Narrative recall A3** .06 
First-grade mediators 

Symbolic mapping -- 2578 

Calculation -- Be Salas 
Controls Included Included 


Note. Included = all models presented include the full list of control variables: age at end of pre- 
k, retained a grade level, gender, ELL status in pre-k, ethnicity, pre-k school type (Head Start or 
public), and socio-economic status (respondent’s education level and income level). *p < .05. 
tp <= .01. ***p <..001. 
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Table 7 


First-Grade Skills as Mediators of the Association Between End of Pre-K Skills and Sixth-Grade 
TCAP MATH Scores 


Predicting Mediators in First Grade 


Symbolic Mapping Calculation 
Pre-k predictors 
Repeating Patterning 2are* glee 
Nonsymbolic quantity 2arr* 22 ee 
Narrative recall ae 3 
Controls Included Included 


Predicting Sixth-Grade TCAP MATH 


Without Mediators With Mediators 


Pre-k predictors 


Repeating Patterning Papas .08 

Nonsymbolic quantity tee 09 

Narrative recall a .08 
First-grade mediators 

Symbolic mapping -- Lorre 

Calculation -- LOPES 
Controls Included Included 


Note. Included = all models presented include the full list of control variables: age at end of pre- 
k, retained a grade level, gender, ELL status in pre-k, ethnicity, pre-k school type (Head Start or 
public), and socio-economic status (respondent’s education level and income level). *p < .05. 
tos Ol, 8" p< 001 


